On the Epsilon -entropy and the rate-distortion function of certain non-Gaussian processes

نویسندگان

  • Jacob Binia
  • Moshe Zakai
  • Jacob Ziv
چکیده

-Let C = {5(t), 0 5 t I T} be a process with covariance function K(s,t ) and E jf t'(t) dt < co. It is proved that for every E > 0 the E-entropy H,(T) satisfies where & is a Gaussian process with the covarhmce K&t) and &‘;,(T) is the entropy of the measure induced by c (in function space) with respect to that induced by &,. It is also shown that if ze,(T) < co, then, as E + 0 Furthermore, if there exists a Gaussian process g = {g(t); 0 5 t 5 T} such that y%(T) < co, then the ratio between H,(5) and H,(g) goes to one as E goes to zero. Similar results are given for the rate-distortion function, and some particular examples are worked out in detail. Some cases for which A$,(@ = 00 are discussed, and asymptotic bounds on H,(T), expressed in terms of H&&J, are derived.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The Rate of Entropy for Gaussian Processes

In this paper, we show that in order to obtain the Tsallis entropy rate for stochastic processes, we can use the limit of conditional entropy, as it was done for the case of Shannon and Renyi entropy rates. Using that we can obtain Tsallis entropy rate for stationary Gaussian processes. Finally, we derive the relation between Renyi, Shannon and Tsallis entropy rates for stationary Gaussian proc...

متن کامل

ADK Entropy and ADK Entropy Rate in Irreducible- Aperiodic Markov Chain and Gaussian Processes

In this paper, the two parameter ADK entropy, as a generalized of Re'nyi entropy, is considered and some properties of it, are investigated. We will see that the ADK entropy for continuous random variables is invariant under a location and is not invariant under a scale transformation of the random variable. Furthermore, the joint ADK entropy, conditional ADK entropy, and chain rule of this ent...

متن کامل

Rate-Distortion Bounds for an Epsilon-Insensitive Distortion Measure

Direct evaluation of the rate-distortion function has rarely been achieved when it is strictly greater than its Shannon lower bound. In this paper, we consider the rate-distortion function for the distortion measure defined by an ε-insensitive loss function. We first present the Shannon lower bound applicable to any source distribution with finite differential entropy. Then, focusing on the Lap...

متن کامل

Upper Bounds for the Rate Distortion Function of Finite-Length Data Blocks of Gaussian WSS Sources

In this paper, we present upper bounds for the rate distortion function (RDF) of finite-length data blocks of Gaussian wide sense stationary (WSS) sources and we propose coding strategies to achieve such bounds. In order to obtain those bounds, we previously derive new results on the discrete Fourier transform (DFT) of WSS processes.

متن کامل

On the Information Dimension of Stochastic Processes

In 1959, Rényi proposed the information dimension and the d-dimensional entropy to measure the information content of general random variables. This paper proposes a generalization of information dimension to stationary stochastic processes by defining the information dimension rate as the entropy rate of the uniformly-quantized stochastic process divided by minus the logarithm of the quantizer...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • IEEE Trans. Information Theory

دوره 20  شماره 

صفحات  -

تاریخ انتشار 1974